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The validity of Frys Readability Graph for determining grade level readability 
scores was compared with the Spache Formula, the cloze technique, and 
in the case of seven primaryHevel books. Descriptions of these four indicated that to 
determine grade level, Frys Readability Graph plots the total number of syllsWes wi 
the total number of sentences for a lOu-word passage. The materials used or 
comparative analysis were selected doze passages read aloud by 30 P™ary grade 
children. Percent of errors was recorded for reading of the words not deleted, and 
grade level readability scores were computed by the Readability Graph and the 
Spache Formula. Rank order correlations showed highly consistent correlations tor an 
four methods. The Readability Graph yielded about the same level scores as the 
Spache Formula. The cloze method was (udged to be the most accurate and the most 
capable of making fine distinctions; however its use is limited because it requires a 
group of subjects to read the selections for evaluation at ^ 
references are included. This research was funded under Title III of ESEA.CGni 
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Tbia jpfipsr reports a dot^avard extension of the validity of the 
Readability Graph that appeared In the Journal of Heading (Fry, 1S68). 

In that article the Readability Graph ^«s compared with readability 
scores obtained by using the l[Mde~Chall» Rotel, Flcach and SRA formulas 
and with a set of comprehensioa scores of 10th graders o The books ranked 
were at the 5tb grade through high school level© of difficulty. This 
article reports grade level scores „ or ranking 9 for seven books* mainly 
within the primary levels of difficulty. Rank order correlations are 

I 

also reported between th® Readability Graph and the Spache formula 0 an 

oral cloze technique, and errors in an oral reading of the words present. 
% 

Back5i!;gound 

The rational® for "one more” readability formula Is based on slm~ 
pHcity. The author feels that th© Roadability Graph is both simple and 
fast. Indeed it Is often lack of simplicity that has kept other read- 
ability formulae from saora widespread uee. The Readability Graph seems 
to work a® well at eh® lower levels as It does at the upper levels, 
although it still need© further validation by investigator® other than 
the author. 









1 




‘I 



f 

! 

i 




U. S. ' DEPARTMENT OF HEALTH, EDUCATION & WELFARE 
OFFICE OF EDUCATION 



THIS DOCUMENT HAS BEEN REPRODUCED EXACTLY AS RECEIVED FROM THE 
PERSON OR ORGANIZATION ORIGINATING IT. POINTS OF VIEW OR OPINIONS! 
STATED DO NOT NECESSARILY REFRESENT OFFICIAL OFFICE OF. EDUCATION 
POSITION OR POLICYh 





Close, For those who arc laoc familiar with the use of the close 
technique m method for determining readability, a word of escplanat.on 
is in order. The. close technique is a procedure in which words are ©sitttid 
(blanked out). The student is then asked to read/ the passage, in thiis 
cate orally, and fill in the blanks with the missing words. One group nt 
students all read the same set of passages and then the passages on which 
the most errors ste made are Judged the hardest. Considerable restarch 
has shown that this is a good measure of readability. For those 

readers Interested In further information on the cloze techi^ic|ue, srtieltts 

# • 

by Taylor (1953), Rankin (1965), Bormuth (1963), Coleman (19i5e) and 

• • 

Gallant (1965) are especially recommended, 

Spache Bbrmula , The Spache Readability Formula is perha|«s the best; 
kaom primary level readability formula. . It has a range from 4 \bout 1.5 
to 4fch grade. The first step in this formula is to count ©ff a\iproxiwsttely 
100 words and^ then to count the number of sentences in this sample. 

Next, every word in the sample is checked sgalnst the Stone revision of 
the Dale list of 769 words, - Words not on the list are **hard,‘* Xhs 

* 

percent of hard words is computed, and then the average sentence length Is 

coaqmted. The average sentence length is multiplied by a thrce-declmal- 

* ' 

pUce conaCMit and She pescent of hard word, word length Is nultiplled by 
a dlffarent thrca~deciixal”place non, taut* The,, two products are then 
added to a third constant, producing a grade level aatlmata, Spache 
iuggeata that five to tan swples per book be averaged together* Bowavar^ 



it is mt quite Chat simple, there are ten other rules for whac to do la 
count iug verb fortes * plurals «, posseseivc endings » adjectival an<? adverbial 
endings » hyphenated words ^ contractions and a few other things. 

tha computational part of this procedure has been nimplified by 

# * 

Xfnniel Safier, who has developed a table that Incorporates the sonstanto ' 
and eliminates several steps (Spache, 1966). 

Readability Graph . Tlie procedure for using the Readability Graph la 
aoiaevhat simpler: (1) count the total number of syllables in a 100 word 
passage; (2) count the total number of sentences In the passage; (3; plot 
the two scores on the Readability Graph for the grade level of tive passage* 
there is no computation or grammar rules about such things as advvrbial 
•ndings to worry about. For books and longer articles I recommend an 

avaraga of three sets of sentence length and syllable counts; in tho case 

* 

of great variability* add a few more samples. The Readability Gra;»b does 

« 

have one grammatical rule: skip all proper nouns. 

Reading. Oral reading has long been used judge the reading 

s 

ability of a student. A number of* students are asked to read one |iassa{i.e. 
Those who maka the fewest errors are judged to be the best readers. To 
detenaine readability* one group of students is asked to read several 

I 

passages. The passages on which the most errors are made are judged to be 

« 

s 

the most difficult* or to have the hardest readability. 

Previous Correlational Studiea . Speche (1966) reports that his lortsula 

correlates .36 with the grade levels used by publishers and that RalpV 

« 

Steiger found a rank order correlation of .70 between the Spache forsula 



mid a siialing of pupil pecformance based on oral reading errors and eoa- 
prehenslott. A Journal of Reading article (Fry, 1963) reported the foUoalng 

4 

rank order corrnlfttions for the u(>per end (grade levels S^IO) of the 
Readability Graphs Isala-Chell fortaula, .94; Flcsch forroulap SRA 
Reading Base Calculator, #98; Betel formula, .78; and average score of a 
group of lOth graders on multiple choice comprehension tests, .93. The 
Botel Fonaula doe. not Include sentence length or any measure of grawBatlcol 

complexity. 

I 

A fair amount of research has been done on the validity of using such 
factors as sentence length and number of syllables or word length to 
determine roadability. Typical of these is the factor analytic atudy by 
SOolurow and Newman (1959) of 44 objective elements In writing. They 
found a high correlation between easy words and monosyllables and reading 
(sase (.90) conversely, a low correlation for polysyllables and 

difficult or rjnk^wn words (.91). Average sentence length correlated .86 

• • 

with dimcoU'i. th.y coitoluded th«t ".ny yardstick which gav. primary 
weight to the uo-called word factor and a lesser but almost equal weight 
to the aenttstiia factor would account for a good desl of the variance in 
readability." JS^rinton and Danielson, after a factor analysis of 20 
language sleme<u‘,s, came to a similar conclusion that "confirms the 

Importance of word length end sentence length." 

Stolurow end jft’t^an euggest that the relative predlv'Jtlve values of 

« 

these factors change with vetletions in ability levels of readers, end 



(1966) 8 la aaalyxiag a iiumto of factor® la readability, atsgg®»t» . 

eurviliaearity. It is poasibie that the carve on the ReadebiUty Graph 

takes this variatioa into account. The curve ia drawn to that in the 

lower levalB oencenee length plays a major role in readability while, 

* 

at the upper levels, word length accounts for most of the variability. 

Since readability formulas have Importance for those teachers, 
writers and editors who are preparing material to be read by children,, a 

\ 

word off caution is in order, Vork from high-frequency word lists and 
try for a simple style with laany, but not all, short sentences. Simply 
cutting long sentences in half and tesking word substitutions, like **o»** 
for ’'bullock**, might not' have the desired effect,. Use the Readability 
Graph after the passage has been written. 

Method 

t 

The purpose of this report Is to validate the lover end of the 

•« 

Readability Graph by showing the ranking of passages from primary-lewal 
• ^ . 

books by scores obtained from* the Readability Graph, the Spache Readability 

yornula, a close procedure, and oral reading error scores. Rank order 

correlations art computed for the four measures, 

U»a work reported on close passages is part of a larger project 

being conducted by Douglas Porter and Helen Popp at the Harvard Univerallr 

Office of Prograaaad Instruction, Thirty 2nd and 3rd grade piiplla were 

asked to read aloud close passages from the aavan books, supplying the 

liissing word®. The number of errors made on words delated was recorded 

* 

for tsch passage. 



6 . 



Porf:ei: «nd Popp used a close procedure which deleted about every 
fifteenth word In a 150 word passage i£ It was a noun, verb, adv'^rb or 
adjective* X£ not one of those classes of words, the word nearest to 
the fifteenth word was deleted* After a tryout,'* a small modification 
was made: if the word deleted was "impossible” for six adult readers 

another word was chosen for deletion. The score obtained is the percent 
of errors made on the passage by 30 pupils. v 

They also obtained the percent of errors the 30 pupils made in oral 

# 

reading of the word not deleted. 

I * 

The same passages used by Porter and Popp were also used to co/4pute 

* . ^ 

grade level readability scores by both the Eeadablllty G^raph and the 
Spache Readability Formula* This work was done by two teachers from the 
Boston Public Schools, Frank Galvin and Alice Healey, who were working 
with the author on a Title III project, sponsored by the loston Public 
Schools, at the Harvard Hnivereity Computer Aided Instruction taboratcry» 

Raaults and Piscusslon 

mm m» i i w w» iii»i> rt i iwi «»»ii ' i**w i iMig i u« ■ i ^ 

« 

All four methods, the Readability Graph, the Spaehe Read.ibility 
formula, tha cloxa procadure, and oral raading errors ranked the diffir,nlty 

f 

level of the passagta quite wall (sea Table 1). Xq my opinion the cl^ia « 

method was tha most accurate and made the finest distinctions. Tha cloia i of 

arror scores ranged from 12 to 80« Were it not for tha enormous amount of 

^ . 

« 

tlma this method takes, dote i^roctdure would ba an excellent way t^ 

determine readability. Xtt addition, to the time it take© to make the cloze 

« 

passages, a number 

« 




©f {Sl££er«nt pastfages must be tested at the same time on the. suae stoiip 

children* Tou cannot i?ttuifn to the same group of children several eionth* 

later, for their reading abilities will have changed and the close error 

scores will not be comparable. As a research tool the method is excellent 

• ♦ 

but for practical purposes it is all but impossible to use. 

The.matbod using oral reading errors suffera from come of the same 
limitations. Basically, you can rank a batch of toaterials at only ona 
tima with a group of children. The time needed to construct the cloaa 
passages is saved, and the administration is somewhat faster, but It is 
still very tlme-eonsumlng to hear 30 primary grade children read what, for 
them, are rather lonjs passiagea. We also feel that the oral rdading scores 
are neither aa accurate nor aa fine grain as the close acores. Table 1 

showa that two hooka. What Spot? and Mlssisalppl gossum, both recaivid 

» 

the Bmt oral reading score, yet the three other nethoda all agraa tfeat 

there is a definite difference in readability . leaver theleas, the us< of 

. 

oral reading acoroa is sn interesting method of Judging readability, 
and ona not often used. It has the advantage of being an objective, 
independent, and different validation procedure. 

Eeadability formulas are often validated on such non-obj active 
criteria as subjective Juigment or publishara* rccoamandaticms. Or th«y 

are validated by comparing them with other formulas. These methods art 

* 

tsuot tnrongtf but we must continually keep in mind that the real basis for 
'iceadability is whether n child can read the material. Therefore, validity 
»aaour«iD that uoo children shiuld receive high priority. For this raiison 



0 



I like to 806 oral reading errors used lnfire«@ingly In research ^;o 

validate readability forsmla»„ although the time factor limits Ite uee 
for practical purposes « 

* 

1!ha Spache f onmla ranked the pessagea fairly ^ell , but it; did 
sottCt fault#. It reported a readability level for Charlie and the Chocola te 
yactory which was iaeonsistent ii?ith the result o of the three other ai©thsda« 

It also reported a readability level of 4o2 for Orlando o The Brave ?ulfcu'i?© 
a point beyond the fomula'’# range ao we had to use another formula 
CFleaeh) to determine grade level. 

Hencet one difficulty that we see is that the Spache formula cannot 

« « 

rank books above 4.0 while the Flesch, Dale**Chall and others canm^t rank 
hooka below 4.0. Those using these formulas in imidHslementary levels must 

use one formula for the upper level and another for the lower level i aomttixias 

, ♦ 

without good articulation. 

The Spache formula gives grade level to a tenth of a grade (one 

V « 

dstcimal place) but this appearance of accuracy could be misleading. ' 

Spaebe reports a probable error of eetlmata in predicting grade level of a 
book| using bis formula » of 3.3 months. This means that half the time tha 
true score of a book lies within a 6.6 months’ band centered around the 
jicora* obtained by working the formula t and that half the time the real 
grade leval lies outside the 6.6 months’ band. Anyone who thlaks he is 
Judging the grade level of a passage to within one tenth of' a grads level 
by using the Spadie formula is kidding himself. * 



ERIC 



fjS’-r. 









n 



The ReadabiXity Graph ranked the pasaagea quite irall and yielded 

about Che aame grade level aeores as th^ Spaeho formula « The Graph did 

mt alarank any books* but it did not make the fine d'.stint'tions of the 

cloze proiiodure* The rank order correlations in ^abli; 2 show a high 

degree of consistency between the Graph and the other metliods* It ie 

interesting that both th.^ Spache formula and the Readtbility Gra;>h 

correlate about as veil with the cloze passages* In studying the data 

X found that the Spache formula gained some consistenc/ by making finer 

distinctions among the first three books* but lost soms by mif placing 

one book. Sovever* both Che Spache formula and the Readability Graph 

had ve!^ high correlations with the cloze method and jatiefstcory eorre** 
• 

lations with the oral reading method and each other. 
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Book 


Fry Grade 
Level 


Spache Grade 
Level 


Close Eri?@rs 

X 

m 


Oral Beading 

Errors X 

• 


& 

Have Ften 


1 


1.4 


12 


f 

6.4 ’ 1 


^reen Eggs 
i lam 


1 


lo8 


16 


5.4 


l«et*s Get 
Tattles 


1 


2.1 


37 


10.3 


Ubat Spot? 


a 


2.7 


42 


. 11.7 


Cbarlie ft The 
Chocolate Factory 


3 


2.5 


49 


16.7 


Mississippi 

Fossum 


3 


3.6 


58 


11.7 


OtlandOs, The 
Brave Vulture 


7 


6* 

« 


80 


21.1 
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Tmbl« 1. A comparison of mean readability grade level 
scores on the Spache & Fry formulas and close error and oral 
reading error scores by 30 atudents on 7 books. 
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Oral Reading 
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Table 2 » Rank order correlations beUfesn th« 
Spaehft Forttula» Fry Readability Graph » cloze errors 
and oral reading errors* 
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